Evaluating medical residents as managers of care: a critical appraisal of assessment methods

INTRODUCTION The increasing demands for effective and efficient health care delivery systems worldwide have resulted in an expansion of the desired competencies that physicians need to possess upon graduation. Presently, medical residents require additional professional competencies that can prepare them to practice adequately in a continuously changing health care environment. Recent studies show that despite the importance of competency-based training, the development and evaluation of management competencies in residents during residency training is inadequate. The aim of this literature review was to find out which assessment methods are currently being used to evaluate trainees' management competencies and which, if any, of these methods make use of valid and reliable instruments. METHODS In September 2012, a thorough search of the literature was performed using the PubMed, Cochrane, Embase®, MEDLINE®, and ERIC databases. Additional searches included scanning the references of relevant articles and sifting through the "related topics" displayed by the databases. RESULTS A total of 25 out of 178 articles were selected for final review. Four broad categories emerged after analysis that best reflected their content: 1) measurement tools used to evaluate the effect of implemented curricular interventions; 2) measurement tools based on recommendations from consensus surveys or conventions; 3) measurement tools for assessing general competencies, which included care-management; and 4) measurement tools focusing exclusively on care-management competencies. CONCLUSION Little information was found about (validated) assessment tools being used to measure care-management competence in practice. Our findings suggest that a combination of assessment tools should be used when evaluating residents' care-management competencies.